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PROGRAMMABLE RESOLUTION CMOS IMAGE SENSOR 

CROSS-REFERENCE TO RELATED APPLICATIONS 

This application, is related to U.S. Provisional Patent Application, Serial No. 
60/252,892, filed November 27, 2000, -which is incorporated in its entirety by reference 
herein. 

FIELD OF THE INVENTION 

The present invention relates to image sensors generally and to programmable 
resolution image sensors in particular. 

BACKGROUND OF THE INVENTION 

Image processing of various types involves trading image resolution against other 
desired characteristics. For example, image recognition processing speed is highly 
dependent on the number of processed pixels per frame and therefore, the higher the 
desired speed, the lower the resolution should be. Similarly, tracking of fast moving 
objects might dictate frame rates higher than those acceptable to the human eye, such as 30 
frames/sec (NTSC) or 25 frames/sec (PAL). 

A simple technique to accomplish higher frame rates is called "pixel dilution" and 
it involves skipping over and reading out every n-th pixel in a row, and every m-th row. 
This results in a higher frame rate, but also in a lower resolution. 

More sophisticated methods may involve image processing. In the prior ait, the 
image processing was done away from the focal plane. Recently, with the revival of active 
pixel sensor (APS) -based CMOS image sensors, there is a tendency to embed image 
processing functions on the same die with the image sensor, as close as possible to the focal 
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plane or in the focal plane itself. 

Much of the work on varying the image sensor's resolution has been performed in 
die last decade, in context with the APS-photo-gate type image sensors. An image sensor, 
which is configurable to yield varying resolution images, is a multiresolution image sensor. 
Such a sensor has row and column averagers, which combine a configurable number of 
same-row adjacent pixels, and a configurable number of adjacent columns, and output a 
row/column block average. These averagers are implemented just ahead of the image 
sensor’s video output and follow the data acquisition from the focal plane. The method 
outputs less "pixels" and therefore allows for higher frame rates. It also "smoothes" the 
image. The method is less than optimal and has several disadvantages, as follows: 

• The averaging is performed in proximity to, but not on the focal plane. Provided 
that focal plane averaging is feasible, there is some Signal to Noise Ratio (SNR) loss 
involved. Averaging circuitry also produces some SNR loss. SNR loss is not desirable 
especially for low lighting conditions, where acquisition of a decipherable image is 
difficult. 

* The averaging circuits add complexity to the image sensor. 

Frame Transfer Image Sensors are also known, which performs the 
multiresolution function outside of the analog memory array itself. This type of sensor 
utilizes the fact that the stored charges of adjacent analog memory add "naturally". Adding 
the charges rather than averaging them results in an improved SNR, which is very 
important for weak signals in bad lighting conditions. The disadvantage of this method lies 
once again in the fact that the charge addition is performed off the focal plane after some 
loss in the signal strength, and some noise has been added. 
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SUMMARY OF THE INVENTION 

i 

An object of the present invention is to provide a novel image sensor. 

In accordance with a preferred embodiment of the present invention, an image 
sensor is described which trades resolution for improved SNR and for higher frame rates. 
The charge or current from a unit cell adds naturally and therefore allows signals to be 
combined at the focal plane. 

Furthermore, the present invention provides an image sensor which can operate in 
a non-interlace, as well as m an interlace mode, The method allows for an improved SNR 
at little or no resolution degradation, when the sensor operates in interlace mode. 

There is therefore provided, in accordance with a preferred embodiment of the 
present invention, an image sensor which includes a plurality of unit cells, each adapted to 
generate charge in response to photons incident thereon and array elements adapted to sum 
charge Rom one or more unit cells at a focal plane of the image sensor. 

There is also provided, in accordance with a second preferred embodiment of the 
present invention, an image sensor which includes a plurality of unit cells, each adapted to 
generate charge in response to photons incident thereon and array elements adapted to 
change a resolution of the output of the image sensor at its focal plane. 

Additionally, in accordance with a preferred embodiment of the present invention, 
the array elements include charge transfer transistors, one per unit cell, a line decoder and a 
column selector. The charge transfer transistors are adapted to transfer charge from their 
associated unit cells when activated. The line decoder is adapted to activate charge transfer 
transistors of one or more lines of unit cells and the column selector is adapted to activate 
one or more columns of unit cells and to combine the charge transferred by activated 
charge transfer transistors of the activated columns. 
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Moreover, in. accordance with a preferred embodiment of the present invention, 
the array elements include an adjacent line unit adapted to indicate to the line decoder to 
activate at least two adjacent lines and to the column selector to select one column thereby 
to combine charge from the corresponding unit cells in adjacent lines. 

5 Furthermore, in accordance with a preferred embodiment of the present invention, 

the array elements include an adjacent column unit adapted to indicate to the line decoder 
to activate one line and to the column selector to combine charge of at least two columns 
thereby to combine charge from at least two unit cells in adjacent columns. 

Further, in accordance with a preferred embodiment of the present invention, the 
1 o array elements include a block unit adapted to indicate to the line decoder to activate U 
adjacent lines and to the column selector to combine charge of V columns thereby to 
combine charge from UxV unit cells in a UxV block. 

Still further, in accordance with a preferred embodiment of the present invention, 
the image sensor also includes an interlace unit adapted to produce video output from the 
1 5 image sensor in an interlace mode. The interlace unit includes a unit adapted to activate the 
adjacent line unit to combine charge of pairs of unit cells in adjacent lines beginning with 
the odd lines for an odd field output and of adjacent lines beginning with the even lines for 
an even field output. 

Moreover, in accordance with a preferred embodiment of the present invention, 
20 the image sensor also includes an intercolumn unit adapted to produce video output from 
the image sensor in an intercolumn mode. The intercolumn unit includes a unit adapted to 
activate the adjacent column unit to combine charge of pairs of adjacent columns beginning 
with the odd columns for an odd field output and of adjacent columns beginning with the 
even columns for an even field output. 
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Further, in accordance with a preferred embodiment of the present invention, the 
image sensor includes a block interlace unit adapted to produce video output from the 
image sensor in a block interlace mode. The block interlace unit includes a unit adapted to 
activate the block unit to combine charge of 2x2 blocks wherein the blocks of an odd field 
output begin with the block whose upper left-hand unit cell is in the first column, first line 
and wherein the blocks of an even field output begin with the block whose upper left-hand 
unit cell is in the second column, second line. 

Finally, the present invention includes the methods performed by the image 

sensor, 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention, will be understood and appreciated more fully from the 
following detailed description taken in conjunction with the appended drawings in which: 

Fig. 1 is a circuit diagram illustration of a portion of an image sensor, constructed 
5 and operative in accordance with a preferred embodiment of the present invention, showing 
two unit cells from two adjacent lines and elements for sensing their charge; 

Fig. 2 is a circuit diagram illustration of a portion of an image sensor, constructed 
and operative in accordance with a preferred embodiment of the present invention, showing 
two unit cells from two adjacent columns and elements for sensing their charge; 

10 Fig. 3 is a block diagram illustration of one embodiment of the image sensor of the 

present invention; 

Figs. 4A, 4B and 4C are schematic illustrations of three modes of generating 
programmable resolution; 

Figs 5A, 5B and 5C are schematic illustrations of three modes of achieving 
15 interlace signals using the image sensor of the present invention; 

Fig. 6 is a block diagram illustration of a further embodiment of the image sensor 
of the present invention; 

Fig. 7 is a block diagram illustration of a line decoder forming part of the image 
sensor of Fig. 6; 

20 Fig. 8 is a block diagram illustration of a column selector decoder forming part of 

the image sensor of Fig. 6; and 

Fig. 9 is a block diagram illustration of a video multiplexer forming part of the 
image sensor of Fig. 6. 
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DETAILED DESCRIPTION OF THE PRESENT INVENTION 

Reference is now made to Fig. 1 and 2, which illustrate two alternative 
embodiments of the present invention. Both figures show two adjacent unit cells, where the 
two unit cells in Fig. 1 are in the same column and the two unit cells of Fig. 2 are in the 
5 same row. Both unit cells are of the direct injection, charge-sensing type. 

In the present invention, the charge of adjacent cells may be separately sensed or 
may be combined, as desired. When the charge is separately read, the resolution is high (i.e. 
there are more pixels). When tire charges axe combined, the resolution is lower (i.e. fewer 
pixels); however, the signal to noise ratio (SNR) is much higher in this latter case than for 
10 the higher resolution case. 

As can be seen in Figs. 1 and 2, described in more detail hereinbelow, the 
programmable resolution function is combined with the sense function, at the output of the 
unit cells. Therefore, the noise contribution to the video signal is minimal, Furthermore, 
the present invention improves the signal to noise ratio since it simply adds the charge or 
15 current of adjacent unit cells rather than averaging the charge or current. 

Figs. 1 and 2 depict two "adjacent" unit cells UCi and UCh- These unit cells are 
Direct Injection (DI) - Charge-Sensing Unit Cells. "Adjacent" is defined as being located 
near each other in the array and meeting the following conditions: 

Let Qi and Q 2 be the charge signals accumulated in adjacent unit cells, UCi and 
20 UC2, respectively. Then 

(1) G, - Q + e 

(2) g 2 =Q-s 


25 


where, 
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and, 


5 


(3) Q = Qi- t - Qi 


(4) s = 


Q\ 0.2 
2 



Same Column/Adjacent Rows 

vfl io Fig. 1 depicts two adjacent unit cells UCi and UC 2 located in the same column 

S3 and in two adjacent rows. Each cell comprises a photodetector PDj, a charge integration 

'O control unit 10, a charge integration capacitor Cl; and a charge readout transistor TR. 

Transistors TR are controlled by line read signals LnRd, and the array includes a sense 
f “ amplifier S A per every two unit cells UC, connected to the output of the transistors TR via 

i y 15 a column line 12. 

P Each photodetector PD is light sensitive and produces a photocurrent proportional 

to the intensity of light. Each control circuit 10 controls the photocurrent charge integration 
period (or exposure time) over each integration capacitor CL Following the image 
acquisition, which occurs during exposure, the charge stored in each integration capacitor 
20 Cl is proportional to the photocurrent and length of exposure. The charge stored in each 
integration capacitor Cl is then read out A transition on the relevant LnRd signal from "0" 
to "1" causes the relevant readout transistor TR to turn ON, which results in readout of the 
stored charge. In other words, the charge stored on the relevant integration capacitor Cl is 
transferred via column line 12 to sense amplifier SA. 

25 It will be appreciated that the present invention incorporates any operation that 
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causes a readout transistor to be turned on. This can be a transition to "1" for an n-channel 
type transistor or a transition to "0" for a p-channel type transistor. 

Sense amplifier SA is a charge integration amplifier and comprises an amplifier A, 
a charge integration capacitor C and a switch S that resets the capacitor C (c.g. reduces the 
capacitor’s charge to zero) . To achieve the highest resolution, the charges Qi and Q 2 are 
readout separately. For instance, providing a transition on LnRdi signal causes readout 
transistor TRi of unit cell UC X to transfer charge Qi from integration capacitor CIi to sense 
amplifier SA. At the end of charge transfer process, charge Qi, resides on capacitor C. 
Accordingly, the output voltage V 011tl of sense amplifier SA is, for unit cell UCi: 

( 6 ) 

If the RMS voltage noise signal is e nb then the signal to noise ratio of the output 
of sense amplifier S is, for unit cell UCi: 

(7) SNR, = 

e»i 

Similarly, if there is a transition on line read signal LnRd 2 of unit cell UC 2 , the 
output voltage V out 2 is: 

( 8 ) K !2 \ = ^\q 2 \ 

and, 

(9) SNR - 

e ,2 



where e Il2 is the RMS voltage noise for charge Q 2 and SNR 2 is the corresponding 
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signal to noise ratio. 

For adjacent pixels, 

(10) K l2 \ = \V oun \ = \V ox! \ = ^\Q\ 

5 and, 

(11) e rtl se„ 2 sze, 

(12) SNR, = SNR 2 = SNR 

10 Higher frame rates can be accomplished by pairing pixels in the same column, and 

simultaneously reading out the accumulated charge in two adjacent unit cells. The unit 
cells UCi and UC 2 can be read out at the same time by providing a transition on line read 
signals LnRdi and LnRd 2 at generally the same time, thus causing transistors TR, and TR2 
to turn ON generally simultaneously. The accumulated charges Qi, and Q 2 are transferred 
15 from unit cells UCi and UC2 into the capacitor C of sense amplifier SA- Therefore, the 
signal voltage V ral is, 

(i3)F w ,-^-|a+e 2 h-|*|e| 

In other words, the output signal is twice as large when two adjacent unit cells are 
20 read out generally simultaneously in comparison to when each cell is read out separately. 

For uncorrelated noise sources enj and en 2 , the equivalent RMS voltage noise 
source when simultaneously read is, 

(14) e„ - -je 2 n , +ef 2 = ^2 • e„ 

25 Therefore the signal to noise ratio SNR. 2,1 when two adjacent rows/same column 
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pixels are read out simultaneously is: 

(15) SNR 2 l = 42* SNR 

It will be appreciated that summing the signals accumulated in two adjacent unit 
5 cells during a single exposure results in an improvement in the signal to noise ratio by a 
factor of ”4{ 2). This involves a reduction in the vertical resolution and an increase in 
readout rate by a factor of 2 . 

Same-Row/Adjacent Columns 

10 Fig. 2 depicts two unit cells UC 3 and UC4 in the same row but in two adjacent 

columns, two sense amplifiers SA] and SA 2 and an amplifier selector AS. Each unit cell 
UC 3 and UC 4 has the same elements as the unit cells of Fig. 1 and will not be described 
further. Each sense amplifier SAi and SA 2 has the same elements as the sense amplifier of 
Fig. 1 and will not be described further. Amplifier selector AS operates to steer charge from 
15 unit cells UC 3 and UC 4 into sense amplifiers SAi and SA 2 and comprises four select 
transistors Ti, T 2 , T 3 , and T* that are controlled by control signals CSi, CS 2s CS 3 and CS 4 , 
respectively. 

Select transistors Ti and T 4 connect the column lines 1 and 3, respectively, directly 
to sense amplifiers SAi and SA 2 , respectively. Select transistors T 2 and T 3 connect column 
20 line 2 to either sense amplifier SAi or SA 2 . 

For the highest resolution, the charge from each unit cell UC, is read by separate 
sense amplifiers SAi. Control signals CSi and CS 4 are set to activate select transistors Ti 
and T 2 and to deactivate select transistors T 3 and T 4 . Thus, the charge stored in unit cell 
UC3 is read out through transistor TR 3 to column line 1, through select transistor Tj in 
amplifier selector AS to sense amplifier SAi. Similarly, the charge stored in unit cell UC 4 

11 
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is read through transistor TR 4 to column, line 2, through- select transistor T 2 to sense 
amplifier SA 2 . The charges Q 3 and Q 4 are read out generally simultaneously by sense 
amplifiers SAi and S A 2 . 

Faster readout can be accomplished by combining the charge of the two adjacent 
same-row pixels into a single sense amplifier. For the case depicted in Fig. 2 , charges Q 3 
and Q 4 are read into sense amplifier SA), while sense amplifier SA 2 is not used. This is 
achieved by pulling providing a transition on the LhRd signal while generally 
simultaneously taming on select transistors T] and T 3 . Select transistors T 2 and T 4 stay in 
the OFF condition. Table 1 lists the valid states for the four select transistors Ti, T 2 , T 3 and 

T 4 . 


Table 1: 


1 Select Signal Combination 

Connection 


CSi 

cs 2 

cs 3 

CS 4 

Ini 

In2 

In3 


" 0 " 

" 0 " 

" 0 " 

None 

None 

None 


II ^ Tf 

" 0 " 

" 0 " 

Ch 

0 2 

None 

— 

" 0 " 

" 1 " 

"0" 

O! 

O, 

None 

m 

If ^ IT 

" 0 " 

11 2 n 

None 

O 2 

O 2 


It will be appreciated that when the charge of two adjacent unit cells of the same 
row are combined, the resolution of the resultant image is half of that if no charge is 
combined. Furthermore, only generally half of the sense amplifiers contain iow 
information. Therefore, the line readout time is twice as fast. This will also result in 
halving the entire frame readout time. 

A similar SNR. analysis to the one performed for the embodiment of Fig. 1 yields 


a similar result-, 










P-3236-US 


(16) SNR 3A = J2 • SNR 

where SNR. 3,4 is the signal to noise ratio when the charge of two adjacent same- 
row unit cells UC3 and UC4 are combined into a single sense amplifier while SNR is the 
5 signal to noise ratio when charge of one unit cell is read out into an individual sense 
amplifier. 

A block of TJ-Rows/V-Columns 

Reference is now made to Fig. 3, which is a general schematic of an image sensor 
20, constructed and operative in accordance with a preferred embodiment of the present 
10 invention. Image sensor 20 comprises a multiplicity of unit cells 22, such as the ones 
described hereinabove with respect to Figs. 1 and 2, a line decoder 24, a column selector 26 
and a video output multiplexer (MUX) 28. 

Line decoder 24 is capable of selecting, generally simultaneously, a group of U 
rows where U is a programmable number. Thus, in the first readout cycle, line read signals 
15 LnRdi to LnRdu have transitions thereon while the remaining lines do not. During the next 
readout cycle, line read signals LnRd u +i, to LnRd 2u have transitions thereon while the 
remaining lines do not, and so on. 

Column selector 26 is capable of selecting, generally simultaneously, a group of V 
columns where V is a programmable number. Thus, the first V Unit Cells UQ to UC V are 
20 generally simultaneously read out to the first sense amplifier SAi, the second V Unit Cells 
UCv+i, to UC 2v are simultaneously read out to sense amplifier SAy+i, and so on. 

Video output MUX 28 outputs the signal from a single sense amplifier to the 
video output. MUX 28 is programmed to produce the outputs of those sense amplifiers that 
contain valid information, that is, SAi, SA v h.i,SA 2v +i and SAnv+i. 

25 Image sensor 20 operates by reading UxV blocks at a time to a single sense 
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amplifier (i.e. the charge of the unit cells in the block are combined and are read by the 
sense amplifier for the block). U and V are programmable numbers, which control the 
operation of line decoder 24, column selector 26 and video MUX 28, 

For the sake of simplicity, assume that M is divisible by U, and N is divisible by 
5 V. We define the following variables: 

Tpoik is the basic unit cell clock period, used for readout- Thus readout from a 
single sense amplifier is performed in a single unit cell clock period. 

T° m is the readout time for the entire array for the highest resolution case (i.e, 
each unit cell is individually read into a separate sense amplifier). For this case: 
io (17) Tf = M • N *T Pak 


T u,v jm is the readout time for a UxV block into a single sense amplifier. 


(18) Tlf = 


M_ N_ 
U * V 


• T. 


PClk 


15 


or, 


(19) Tlf ~ 


U*V 


When the stored information is read in U X V blocks, the readout time is reduced 
by a factor of l i*V, the horizontal resolution is reduced by a factor of V, and the vertical 
20 resolution by a factor of U. 

The signal to noise ratio can determined for two cases, a variable frame rate and a 
fixed frame rate. Variable Frame Rate: In some applications, such as the acquisition of 
images of moving object, a variable frame rate is important. Wren an object is 
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approaching the camera, its angular speed is higher. Therefore, for fast moving objects, 
more frames per second is essentiaL The present invention provides this, without unit cell 
dilution. 

In this case, multi-resolution is applied to increase the Same readout. For this 

case, 

rpO 

(20) T = - m +Tj 
v U*V 


and. 


(21) FR — ^ 


where, 

Ti - is the charge integration time, 

T - is the frame cycle time, 

FR - is the frame rate. 

Formula (20) indicates that higher frame rates can be traded for lower resolutions. 
The signal to noise ratio SNR„,^ can be also derived, 

(22) SNRy y = SU • V • SNR 

where SNR is the signal to noise ratio for the highest resolution. 

As can be seen, when the unit cells are readout in UxV blocks, the signal to noise 
ratio improves by a factor of V(U*V)- 

Fixed Frame Rate: For still video, poor lighting conditions, or when a compressed 
picture form is desirable (for the sake of saving picture storage space), one may utilize the 
multi-resolution of the present method to improve the sensitivity of the SNR. For real-time 
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video either displayed on a TV or on a computer monitor, the frame rate is fixed. For this 
case, the maximum charge integration time is determined by the frame rate and by the 
readout time, where T°i jmax is the maximum integration time for the case where each unit 
cell is individually read. 

5 (23) T,° ;m =-±--T° 


Reading out the video in UxV blocks reduces the readout time by a factor U*V 
and therefore allows charge integration time to be increased, 


(24) 


u,y 

max 


1 T° 

_ _ 1 Ad 

FR U*V 


lQn Since the signal to noise ratio improves as a square root of the integration charge 

iJJ time, the improvement of the SNR for the fixed frame rate SNR^’Sj v is governed by 


(2 5) SNR™ 

Jy ]l 1 -FR»T° 


■SNR 


ffj For example, for an image sensor which operates at a fixed frame rate of 30 

l g== frames/sec with a 16 msec readout time at the highest resolution has a reduction in 
horizontal and vertical resolution by a factor of 2 and an improvement in the signal to noise 
ration by a factor of 2.6. 

Image sensor 20 is capable of programmable resolution. Reference is now made to 
Figs. 4A, 4B, 4C and 4D, which illustrate its operation for four different cases. 

20 Fig. 4A illustrates the highest horizontal resolution but half the vertical resolution. 

The charge from two unit cells 30 and 32 in the same column but in adjacent rows is 
generally simultaneously transferred into the same sense amplifier. This corresponds to the 
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case of Fig. 1. The number of lines to be read is half the maximum number while the 
number of unit cells per line is maximal. To display a full-size picture on a video display, 
each line of data must be repeated twice. Tins is normally done from an external frame 
buffer and not from the image sensor directly. 

Fig. 4E illustrates the highest vertical resolution but half the horizontal resolution. 
The charge from two unit cells 34 and 36 in the same row but adjacent columns is generally 
simultaneously read into a single sense amplifier. This corresponds to the case of Fig. 2, 

Fig. 4C depicts the case for which the resolution is reduced by a factor of two both 
horizontally and vertically. Thus, the charge from a 2x2 block 3 8 is combined into one 
sense amplifier via two adjacent column lines, This results in significant SNR 
improvement. 

The embodiments of Figs. 4A, 4B and 4C show combining unit cells of two lines 
and/or two columns. It will be appreciated that the present invention incorporates the 
embodiments of Figs. 4A, 4B and 4C as well as all other embodiments combining multiple 
lines and/or multiple columns. 

Programmable Resolution, Interlace-Mode Image Sensors 

TV displays and often computer monitors operate in an interlace mode. This 
requires that the frame readout be performed in odd and even field sub-cycles where, 
during the odd field sub-period, the odd lines are readout, while during the even field sub¬ 
period, the even lines are readout. The term "interlaced" indicates that the even lines are 
located in between the odd lines. 

In the present invention, a simple way to generate an interlaced signal is by the 
acquisition of lines 1, 3, 5. 7, ... for the odd field while reading out the previous even field 
data and then reading out the odd field data while acquiring the even lines 2, 4, 6, 8, ... for 
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the even held, and so on. 

Since each field readout time is half the frame readout time, this results in the 
reduction of the maximum integration time by a factor of two. 

Therefore, 


(26) 


SNR7 = 4= • SNR 

42 


where SNRl^j is the signal to noise ratio for the interlaced image sensor, SNR is 
the SNR for a conventional sequential, frame-type image sensor programmed to its highest 
resolution. 

Reference is now made to Fig. 5A, which illustrates the operation of the present 
invention in interlace mode. For the odd field, the charges from two vertically adjacent unit 
cells 40 and 42 in lines R1 and R2 are combined (as noted by the dashed box around them) 
and simultaneously transferred to the sense amplifier for that column, SAi, in a manner 
similar to that described with respect to Fig. 1. This is true for all unit cells in lines R1 and 
R2 (i.e. charges from two vertically adjacent unit cells of column C2 are combined and 
simultaneously transferred to the sense amplifier for that column, SA 2 , etc.). This is 
followed by a similar action for lines R3 and R4, followed by lines R5 and R6, and so on, 
until the last two Lines. 

The odd field readout is followed by the readout of the even field. The even field 
data acquisition is generally simultaneous with the odd field readout. The even field 
readout involves pairing of lines R2 and R3 (as indicated by the dotted box around the unit 
cells), followed by lines R4 and R5, followed by lines R6 and R7, and so on. 

For this mode of operation the signal to noise ratio SNRI 2 ,i is, 

(27) SNRI V = SNR 
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and, 

(28) SNRI X[ = V2 • SNRI 

5 Reference is now briefly made to Fig. 5B, which illustrates horizontal field 

interlacing, in a method called intercolumn mode. This is accomplished by combining 
charge from columns Cl and C2 into sense amplifier SAi, that of columns C3 and C4 into 
sense amplifier SAi, that of columns CS and C6 into sense amplifier SA 5 , etc. and reading 
out the acquired data during the odd field time period. The even field data readout follows 
1 0 by steering columns C2 and C3 into sense amplifier SA 2 , columns C4 and C5 into sense 

amplifier SA4, columns C6 and C7 into SA <5 and reading out the acquired data during the 
f=i even field time period. This mode yields almost the same resolution as the non- 
-O interlaced/highest-resolution mode, since the number of unit cells per line is effectively tire 
|ij same. 

15 |II The method can be used in the context of non-interlaced displays, if an external 

g video buffer is used to reorder the frame in a way suitable for a display, that is, that the odd 
ju "pixel" which combines columns j and j+ 1 will be followed by the same-line adjacent even 
%j "pixel" which combines columns j+1, and j+2. While this method does not have any SNR 
i I advantages over the standard, non-interlace/highest resolution mode, it does result in 
20 further SNR gains, no resolution cost and almost no hardware complications. 

Fig. 5C shows a further interlace method where each output "pixel’’ is formed 
from a 2x2 block of unit cells. The odd field begins with block 50 having the unit cells 
from adjacent columns beginning with the odd columns (i.e. columns 1, 3, 5, etc) and 
adjacent lines beginning with the odd lines (i.e. lines 1, 3, 5). Thus, block 50 has unit cells 
25 (Rl, Cl), (Rl, C2), (R2, Cl) and (R2, C2). The next block, block 52, has unit cells (Rl, 
C3), (Rl, C4), (R2, C3) and (R2, C4). The even field begins with block 54 having the unit 
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cells from adjacent columns beginning with the even columns (i.e. columns 2, 4, 6, etc) and 
adjacent lines beginning with the even lines (i.e. lines 2, 4, 6). Thus, block 54 has unit cells 
(R2, C2), (R2, C3), (R3, C2) and (R3, C3). The next block, block 56, has emit cells (R2, 
C4), (R2, C5), (R3, C4) and (R3, C5). 

It is noted that displays are designed to correctly position the even lines between 
the odd lines. However, there is no mechanism that positions the even columns between 
die odd columns. Therefore, the image sensor must be designed to account for this. For 
example, for the even field, and the horizontal interlace mode, the image sensor must delay 
all the lines by one additional unit cell clock period Tpclk. 

It is also noted that the description hereinabove assumes that M and N are even 
numbers. Therefore, there is one less row and one less column in the even field compared 
to the odd field. If N or M are odd, the number of rows or the number of columns, 
respectively, will be the same for the two fields. 

The method of Fig. 5C produces almost the same horizontal and vertical 
resolution as an image sensor operating in a non-interlace/highest-resolution mode; 
however, the method of Fig. 5C has a better SNR. The maximum integration time is no 
different than for the interlaced mode, as described for the case depicted in Fig. 5A. 
However, the method of Fig. 5C provides a signal with twice the magnitude. This, of 
course, results in an improved SNR-, 

(29) SNRJ Z2 = sFl • SNR 

and, 

(30) SNRJ 12 - 2 • SNRI 

where SNRI 2 ,2 is the signal to noise ratio for Fig. 5C, in which the charge of four adjacent 
unit cells are combined into a single sense amplifier. 
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The present invention has been described for direct injection (DI) type of unit 
cells, which, are based upon charge readout. The present invention also applies to unit cells 
that are based upon current readout 

The present invention is not limited to summing up the output of two vertically 
5 adjacent or two horizontally adjacent unit cells, As described in the context of Fig, 3, any 
rectangular block of neighboring pixels charges can be added in non-interlace or interlace 
modes. This reduces the resolution and results in a higher frame rate and an improved 
SNR, but adds to the hardware complexity. 

It will be appreciated that the present invention is unique in that it adds charge 
10 right in the focal plane. This results in a lower noise compared to methods for which this is 
f=t done later in the signal chain. It also results in a stronger signal coming out of the array, 
if I and therefore in an improved SNR, 

|jj Reference is now made to Figs. 6, 7, 8 and 9, which illustrate various elements 

M, necessary to control the image sensor, and its different modes of operation, described 
IS;,: hereinabove. Fig. 6 illustrates an image sensor 100, constructed and operative in 

L± accordance with a preferred embodiment of the present invention and using the methods 
iy described hereinabove with respect to Figs. 1-5, Fig. 7 illustrates a line decoder, Fig. 8 
£2 illustrates a column selector and Fig. 9 illustrates a video multiplexer. The implementations 
described hereiribelow are not the only alternatives and all embodiments are incorporated in 
20 the present invention. 

In accordance with the principles outlined hereinabove, image sensor 100 is fully 
programmable and can operate in either the interlace or non-interlace mode, and at full or 
partial resolution, but with significantly improved SNR and readout. Moreover, the 
programming may be independently performed for the horizontal and the vertical 
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directions. 

Image sensor 100 comprises a unit cell array 102, left and right line decoders 104 
and 106, respectively, a column selector 108 and a video multiplexer 110. Left and right 
line decoders 104 and 106 are typically implemented with the same structure, where each 
5 decoder has M line read LnRdi output signals; however, right line decoder 106 is shifted 
down by one line. Thus, LnRdi for left line decoder 104 is connected to line 1 of the array 
while LnRdi for right line decoder 106 is connected to line 2 of the array, and so on. For 
right line decoder 106, LnRdu is not connected to any line. Lines 2 - M of the array are 
connected to both line decoders 104 and 106 while line 1 is connected to left line decoder 
10 104 only. This arrangement facilitates both the non-interlace and the interlace modes of 

d 5 operation. 

p For the non-interlace mode, the line readout operation is wholly governed by left 

Ji line decoder 104. 

y For the odd field of the interlace mode, the operation is governed by left line 

15 M= decoder 104 and the lines are read out in pairs. Thus, readout of lines 1 and 2 is followed 
ill by lines 3 and 4, etc. until lines M-l and M. 

p For the even field the operation is governed by right line decoder 106. Right line 

decoder 106 performs the same operation as for the odd field but the output is shifted due to 
right lme decoder 106 being connected to the array starting at line 2 rather than at line 1 as 
20 for left line decoder 104. Thus, readout of lines 2 and 3 is followed by readout of lines 4 
and 5, etc. until lines M-2 and M-l. 

Fig. 7 details line decoders 104 and 106. This decoder is capable of selecting an 
individual line or selecting a pair of neighboring lines. The decoder comprises a pre¬ 
decoder 111 and a plurality of row selectors (RSel) 112. Pre-decoder 111 determines which 
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line pairs to activate while row selectors activate the selected rows. 

Pre-decoder 111 has k address inputs and M/2 outputs, where K is defined as: 

log 2 M > k ^ log 2 M -1 

and the output signals are pair line signals Lni i2 , Ln 2r 3 , etc. Pre-decoder 111 selects a line 
pair and is implemented as a conventional decoder structure. 

The output behavior of pre-decoder 111 is defined as: 

Let, 

(31) i - ( LnAdr k , LnAdr t _ x ,LnAdr t _ z , J.nAdr z , LnAdr, \ 
where LnAdr t = "0" or LnAdn =" 1", (LnAdr k ,LnAdr^ I ,LnAdr y ^,■ ..LnAdr 2l LnAdr } ) 2 
is the binary representation of the integer i and 

M 

1 < i — 

2 ^ . 

With these conditions, the outputs of pre-decoder 110 are either logical "0" or logical "1" 

subject to the following: 


(32) Ln 2mi _ ul .i = En , and 
(33) Ln z .^ >p ="0" for p * i 

Thus, if En=0, all of the outputs of line decoder 104 or 106 are logical "0". In 
other words, setting En to "0" disables (he line read operation. This is the default state of 
line decoders 104/106, when there is no active readout. 

The input X of each row selector 112 is connected to one of the outputs Ln 2p -i, 2 p of 
pre-decoder 111. Each row selector 112 has two outputs Oi and 0 2 , which are connected to 
lines LnRd 2p -i and LnRd 2p , respectively, of array 102 (Fig. 6). 

The output signals Oi and 0 2 are functions of input control signals RSj and RS Z 
and on the input I, driven by the signal Ln 2 j-i i2 j, as defined by Table 2: 
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Table 2: 


Inputs 

Out 

puts 

I 

RSi 

rs 2 

Or 

o 2 

"0" 

"0" 

"0" 

z 

z 

n y h 

"0" 

"0" 

z 

z 

"0" 

"0" 

n l" 

"0" 

”0” 

H 11 

"0" 

”1" 

"0" 

M|l? 

"0" 

"1" 

”0" 

"0" 

”0” 

’T" 

"1" 

"0" 

11 ^11 

"0" 

"0" 

"i" 

11 ^ ft 

”0" 

"0" 

i| >j rf 

1 

11 2 M 

M | M 

"1" 

tr ^ m 


Where Z is a high-impedance state also called a tristate. 

5 As can be seen, from Table 2 , the outputs of a row selector 112 are tristated when 

control signals RS t -’'0" and RS2="0" The tri-state is used most often for the interlace 
modes of operation 

T; The combinations in Table 2 can be also described by the following formulas: 

10 pf (34) ^ ^ f OT ji ="0" and RS 2 ="0", otherwise. 

%iLJ “ 2 ^ 


(35) 


O, = RSi • 7 
0, = RS 2 * I 


15 


The line decoder output lines values are subject to the following- 
LnRd 2 ,„ , = Z 

(36) _ p _ for AS, ="0" and RS 2 ="0" , otherwise, 
LnRa 2%p — 2 

(37) LnRd 2 . p ="0" and LnRd Up =“0" for any p * i and 


LnRd 2 .„_ } = -ftS'e/, ■ En 

for d — i 

LnRd 2wp - RSel, • En y 

20 

where the function for i is given in (31). 

Based upon the values of Rse], and RSeI 2 , line decoders 104 and 106 select either 
a single line or two lines at a time. 
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For the highest vertical resolution, when each line is individually read, the line 
signals LnAdrj to LnAdr k become active in order, but stay active for a period of two lines. 
When the odd line is read, RSeli=’T" and RSeh—'0". When the even line is read, 
RSeli="0” andRSel 2 — 

5 When programmed for half the vertical resolution, as described in context with 

Figs. 4A and 4C. two lines are read simultaneously and the lme signals LnAdrj to LnAdn 
become active in order. During the entire readout, RSeli-" 1 "and RSe^-' 1", 

Fig. 8 illustrates programmable column selector 108, which comprises a plurality 
N/2 of amplifier selectors AS 2 P -i, P (detailed in Fig. 2), where p is between 1 and N/2, with 

10 their inputs connected to the column lines Co^p-i, Cofzp and Cokp+i and their outputs 
connected to the inputs In 2 P -i and In 2p of sense amplifiers SA 2 p i and SA 2p) respectively. 
yyTable 1 hereinabove provides the configurations of amplifier selector AS as functions of 
yothe column select signals CSi to CS4 which operate to provide non-interlace or of interlace 
^□operation. 

15 M For horizontal non-interlace there are two modes, the highest resolution and the 

iMhalf resolution mode, which provides a higher SNR. In the highest resolution mode, 
fypSi—"!", CS 2 -T\ CS 3 —'0" and CS 4 =" 0 ". With these control inputs, each amplifier selector 
tAS 2 p.i 2 p connects column lines Cobp-i and Col 2p to inputs In^p-t and In 2 p, respectively, of 
sense amplifiers SA 2p -i and SA 2p and each column is read out separately. 

20 For half resolution, C8j—’1", CS2-"0", CS3="1" and CS4="0”. Amplifier selector 

AS 2 p-i , 2 P connects column lines Col 2p -] and Col, 2 P to input In 2p -i. Inputs In 2 p are not utilized 
and thus, sense amplifiers SA 2p are not active. This configuration supports the modes 
depicted in Figs. 4B and 4-C. 

For horizontal interlace modes, odd columns are read out during the odd field 
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readout and even columns are readout during the even field readout. In this mode, control 
signals CS3="0" and CS 4 —"0" for the both fields. During the odd field readout, control 
signals CSi='T' and CS 2 -'0", and only the odd columns Col 2p -i are read to the odd-indexed 
sense amplifiers SA 2p -i. Following the readout operation, the outputs of the odd-indexed 
5 sense amplifiers are multiplexed to video multiplexer 110. During the even field readout, 
control signals CSi="0" and CS 2 =T'. Tins results in the even columns Col 2p being read to 
the even-indexed sense amplifiers SA 2p . Following the readout, the outputs of the even- 
indexed sense amplifiers SA 2 p are multiplexed to the video multiplexer 110. Thus, in this 
mode of operation, image sensor 100 reads out the odd column pixels during the odd field 
10 and the even column pixels during the even field. 

For the intercolumn and block interlace modes of Figs. 5B and 5C, column 
ijy selector 108 operates as follows: for the odd field readout, control signals CSi~"l", 
13 cs 2 = "0"= CS 3 ="1" and CS 4 ="0", Therefore, column lines Col 2l>1 and Col 2p are connected to 
Jj m P ut hUp-i of sense amplifiers SA 2p _,. Sense amplifiers SA 2 p are disconnected. The charge 
15 yj from two column lines is steered and added together to a single odd-indexed sense 
l. amplifier SA 2p _[. For the even field readout, CSi="0", CS 2 =’T", CS 3 ="0” and CS 4 =’T\ 
fO Fhus, column lines Ool 2p and Col 2 p*l are connected to the input iiiip of sense amplifier 
□ s A 2p . Sense amplifiers SA 2p -l are disconnected. For this field, the charge from two 
columns is steered and combined ai a single even-indexed sense amplifier SA 2p . 

20 Fig. 9 depicts the elements of video multiplexer 110, which comprises a sense 

amplifier unit 120, a column multiplexer 122 and a column decoder 124. 

Sense amplifier unit 120 comprises sense amplifiers SA,, one per column line Col,. 

Column decoder 124 controls which sense amplifier SAj connects to a video 
output line V x . Column decoder 124 outputs a single control output Clj at a time based on 
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an input column, address (ColAdrL-i,ColAdrL. 2 ,... 5 ColAdr 2 ,ColAdr 1; ColAdro )2 where logjN 
< L < log2N-L 

Thus, if 

(3S) i = {ColAdr L _ { , ColAdr^^.^ColAdr^ColAdr^ ,CoL4dr 0 ) 2 + 1 
5 

then Cl =''1”, otherwise for j ^ i Cl } ="0" 

Column multiplexer 122 connects the output of sense amplifier SAj to video 
output line V*. This is performed by activating a per-column transistor CTj whose gate is 
1 0 connected to the per-column output Cli of column decoder 124. 

Column selection is controlled thru the column address ColAdro-ColAdrn and the 
address sequence depends on the desired horizontal resolution, 
p For the highest resolution, non-interlace mode, the address is incremented by 1 

peach pixel cycle, starting with (ColAdr L .i,ColAdn^ 2 ,...,ColAdr 2 ,ColAdri,ColAdr 0 ) 2 = 0 and 
15 yending with (ColAdrL.i,ColAdrL- 2 3 ..- 3 ColAdr 2 ,ColAdr 1 ,ColAdr ( )) 2 - N. For half the 
.§=* resolution, the address is incremented by 2 each pixel cycle. 

= The column address sequencing is identical for all interlace modes. During the 

hk odd field readout, the address is incremented by 2 each pixel cycle, starting with (ColAdn.. 
%J i ColAdr L .2>...,ColAdr2,Co]Adri,ColAdro)2=0 and ending with (ColAdr L -i,ColAdn 

20 | B g ! 2,... ! ColAdr2,ColAdr I ,Co3Adro)2= =: N. During the even field readout, the address is 
incremented by 2 each pixel cycle, starting with (ColAdrL-i.ColAdrL- 
2 ,...,ColAdr 2 ,ColAdri,ColAdro) 2 = 1 and ending with (ColAdrL-i,ColAdrL- 
2 ,-..,ColAdr 2 .ColAdri,ColAdro) 2 = N-l. 

The image sensor of the present invention can be combined with the 
25 programmable resolution method of the invention described in US Serial Number 
09/629,703, filed June 7, 1999, incorporated herein by reference, to accomplish a wider 
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range of resolution/SNR combinations. 

The methods and apparatus disclosed herein have been described without 
reference to specific hardware or software, Rather, the methods and apparatus have been 
described in a manner sufficient to enable persons of ordinary skill in the art to readily 
5 adapt commercially available hardware and software as may be needed to reduce any of the 
embodiments of the present invention to practice without undue experimentation and using 
conventional techniques. 

It will be appreciated by persons skilled in the art that the present invention is not 
limited by what has been particularly shown and described herein above. Rather the scope 
10 of the invention is defined by the claims that follow: 
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